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Abstract 


We prove that a random 3-SAT instance with clause-to-variable 
density less than 3.52 is satisfiable with high probability. The proof 
comes through an algorithm which selects (and sets) a variable de- 
pending on its degree and that of its complement. 


1 Introduction 


There is much interest in understanding “phase transitions” in mathematics, 
computer science, and mathematical physics, and in particular the k-SAT 
phase transition. In the standard model for random k-SAT, a random k- 
CNF formula F(n,cn) with n variables and density c has m = cn random 
clauses independently selected uniformly at random, with replacement, from 
among the 2* Gy proper clauses of length k. The Satisfiability Threshold 
Conjecture asserts that for each k > 2, there exists a constant cz, such that 
for all constants c < cy, F(n,cn) is a.a.s. (asymptotically almost surely) 
satisfiable, while for c > cy it is a.a.s. unsatisfiable. 

The case of 2-SAT is well understood, with Chvatal and Reed [CR92], 
Geordt [Goe96], and Fernandez de la Vega [FdlV92] independently proving 
that co = 1, and Bollobds, Borgs, Chayes, Kim, and Wilson [BBC*] deter- 
mined the “scaling window” to be 1+ O(n—'/3). For k > 2, the conjecture 
remains open. Friedgut proved that for any k and n there is sharp threshold 
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cy(n), leaving open whether c,(n) has a limit c,. With the threshold be- 
havior not understood, considerable attention has been devoted to proving 
density bounds below which a formula is a.a.s. satisfiable (“lower bounds” 
on the putative threshold) and bounds above which it is a.a.s. unsatisfiable 
(“upper bounds”). For k = 3, it is conjectured that cz ~ 4.2, and the best 
upper bound is 4.596 [JSVO00]. 

Existing lower bounds for 3-SAT are all algorithmically based. (By con- 
trast, new lower bounds for k-SAT are based on the second-moment method 
[AM02, APO3].) The earliest such bound of 1.63, due to Broder, Frieze and 
Upfal [BFU93] was based on the “pure-literal rule”: successively setting to 
True literals whose complement does not appear, “reducing” the formula, 
and repeating. The next, 3.003, due to Frieze and Suen [FS96], used the 
“shortest-clause rule”, setting True a random literal from a random short- 
est clause. Skipping over a bound of 3.145 by Achlioptas [Ach00], a bound 
of 3.14 due to Achlioptas and Sorkin [ASO00] again selects a literal from a 
shortest clause, but when the literal is from a 2-clause (the case of interest) 
it sets the literal either True or False depending (optimally) on the num- 
ber of other occurrences of the literal and its negation in 2- and 3-clauses; 
[AS00] extends this to a version which optimally chooses to set one or two 
literals at a time, and sets them optimally, for a bound of 3.26. [ASOO] 
suggests that better bounds may require looking at literal-degree informa- 
tion, in some way harking back to [BFU93]. This approach was taken up 
by Kaporis, Kirousis, and Lalas [KKL02], whose algorithm sets a variable 
of largest degree (a “1-parameter heuristic”) to give a bound of 3.42. It was 
clear that the same approach could be exploited further. 


2 Result, significance, and open problems 


In this paper, we choose a variable according to its degree and that of its 
complement (a 2-parameter heuristic), to get a bound of 3.52. Kaporis 
and Lalas [KL], using a similar but not identical heuristic, independently 
obtained the same bound at around the same time. The purpose of this 
short abstract is twofold. 

First, since the bounds from all heuristics of this sort rely on numerical 
calculations (notably, solutions to differential equations), it is important to 
put on record that our calculations and those of [KL] independently justify 
a value of 3.52, and that we reproduce the 3.42 bound of [KKLO02]. 


‘A bound of 4.506 due to Dubois, Boufkhad, and Mandler [DBMO00] has not appeared 
in journal-refereed form. 


Second, our heuristic (and that of [KL]) efficiently solves denser random 
instances than any other theoretically justified algorithms; since solving 3- 
SAT instances is of practical importance, our algorithm may be of practical 
utility. In that regard, a few remarks. Our heuristic succeeds only with 
a probability that is asymptotically bounded away from 0, but exploiting 
a standard one-step backtracking trick brings the asymptotic probability 
to 1. Also, the algorithms commonly used in practice are Davis-Putnam- 
type backtracking procedures, quite different from the “greedy” approaches 
taken in all the works described above. However, it is easy to imagine using 
the present heuristic as a selection rule for a Davis-Putnam algorithm, pre- 
serving the heuristic’s theoretically justified behavior on random instances, 
while gaining the Davis-Putnam algorithm’s guarantee of a correct answer 
on arbitrary instances. 

Not present in this short abstract is a rigorous justification of our proof 
methodology (fairly easy and familiar), nor of the numerical calculations, 
which to be done rigorously would require theoretically derived Lipschitz 
bounds on a derivative, and interval-arithmetic calculations employing those 
bounds, along with a few other technicalities. 

Future work could include consideration of a variable’s number of ap- 
pearances and that of its complement separately in 2-clauses and 3-clauses 
(a 4-parameter heuristic), which is analyzable in the same framework. In 
at least the 2- and 4-parameter versions of literal-degree heuristics (as op- 
posed to the 1-parameter version), it is not clear how best to select a next 
literal: does a (2,3) literal (2 positive appearances, 3 negative) trump a 
(4,5), or vice-versa? In the 4-parameter version, it is also not clear how 
best to set a chosen literal; this was the question answered in [AS00] for the 
non-degree-spectrum case. An optimal solution to these questions would be 
a most interesting theoretical contribution, and could also give significant 
improvements in the bounds. 


3 Algorithm 


We call a variable with 2 positive and j negative appearances an (i, 7)- 
variable. Our algorithm is defined as follows. 


Algorithm A 
Input: A 3-CNF formula. 


begin 

1 while there exists an unset variable 

2 choose an (i, j)-degree variable using a selection rule 
3 set v True if i < 7 and False otherwise 


4 while there exists a unit clause 
5 set a literal of an arbitrary unit clause True. 
6 if an empty clause is generated report failure; otherwise report success 
end 

The best selection rule we found was this. If there is a “pure” variable 
(one with i = 0 or j = O), select it. Otherwise, choose a variable with 
maximum discrepancy |i — j|, breaking ties in favor of maximal 7+ 7. (This 
identifies a unique unordered pair {2, j}, and all variables with those degrees 
are indistinguishable to the algorithm.) This selection rule satisfies formulas 
up to density 3.52. Other selection rules we tried were less good. Working 
as above but breaking ties in favor of minimal i + 7 only worked up to 
density 3.50. Selecting by maximum i/j instead of i — j only worked up 
to 3.44. Selecting by maximum max{i,7} is equivalent to the approach of 
[KKL02], and we reproduce their 3.42. 


4 Analysis 


In truth, the “natural” algorithm above is not the one analyzed. Rather than 
making O(n) iterations, the analyzed algorithm makes a constant number 
of iterations, in each of which it sets O(n) variables with common degree 
{i, j}- 

It is easily verified that during the algorithm, the formula remains uni- 
formly random conditioned on its degree sequence. To make the calculations 
finite, we truncate the degree sequence at some value h (h = 31 in our calcu- 
lations). Then with n the original number of variables, for 7,7 < h we let nji,; 
be 1/nth the current number of variables of degree (i, 7); np j (and ni,) the 
similar value for variables with > h positive (negative) appearances; and 
Mn,n that for variables with > h positive and negative appearances. Set- 
ting a single (7, j)-variable produces straightforwardly computable expected 
changes A (detailed in Appendix A) to the h?-dimensional vector S of val- 
ues n;,;, and each element of A has order only O(1/n), so the differential 
equation method (see for example [Wor95]) can be used to prove that, as we 
set O(n) variables with common degree (i,j), the vector n;,; almost surely 
almost exactly follows a trajectory described by the solution of a differential 
equation corresponding to A. 

So instead of selecting an (2, 7)-variable as in Algorithm A, we use the 
same selection rule to select a pair (7,7), 7,7 < h, and we set n+ min{6d, n;,;} 
(i, j)-variables at once. Here 6 is a value of our choosing, which could vary 
from round to round, but which we fixed at 10~°. Each such round (in- 
cluding the unit-clause steps it implies) can be described by the differential 


equation method, and our analysis simply consists of simulating the differ- 
ential equations for a constant number of rounds. It is clear that after some 
number of rounds, all the values in S can be made arbitrarily small, and at 
that point we apply the main theorem of Cooper, Frieze, and Sorkin [CFS02] 
to show that the remaining formula is satisfiable a.a.s. (The positive side 
of their result has a natural algorithmic interpretation, so our procedure 
remains algorithmic to the end.) 


5 Differential Equations 


In this section, we describe the differential equations for the case in which 
we have a 2-dimensional table for keeping the expected number of variables 
with k < h positive appearances and | < h negative appearances. Since 
dt (the “time parameter” described before) is very small, w.l.o.g. we can 
assume all values of S remain fixed during a round. Using these values, we 
obtain the new value of S after a round. Suppose we set a variable from cell 
Nz, True (in other words, set a (k,1)-degree variable True). Then writing 4 
to denote the expected increase to a parameter, for such a “free move” we 
have: 
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where My, = Un = 2-M2+3-mz is the total density of appearances of all 
variables and m , is the expected number of unit clauses generated by this 
free move. Here (x,y) = 1 if e = y and zero otherwise. Note also that 
since by definition m, = 0 at the start of a round, at the end, m, = dm, as 
given above. 

After a free move, we have a number of “forced moves” in which the 
literals in all m, unit clauses must be set True to satisfy our formula. A 
literal in a unit clause is a variable from cell (k + 1,1) with probability 


(eer or the negation of a variable from cell (k,/ + 1) with probability 


(Une Ty either case, in the rest of the formula (excepting the unit 


clauses) that variable has degree (k,1). Thus the expected number p of new 
unit clauses produced by one such forced move (the Malthus parameter in 
our Galton-Watson process) is 
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where |/2%2 (see parameter m defined above) is the density of new unit 


clauses after setting a (k’,1')-degree variable True (which happens with prob- 
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and k! site is the density of new unit clauses after setting 
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For such a forced move, the expected parameter changes are: 
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where 6M3(k’,l’,T) has exactly the same formula as dmg defined above, 
likewise for 6Mo(k’,l',T) and dmg, and where by symmetry 6M3(k',l', F) = 
6M3(U',k',T) and 6Mo(k',U’, F) = 6Mo(l’,k’,T). 

Finally, for each 7 and j, 
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We note that the formula for 6’n;,; can be obtained by considering the flow 
which goes in or out for cell nj;,j. 


Reasoning via the Galton-Watson process, we know that the expected 
number of forced moves is “+. Thus the new expected value of S af- 
ter setting a small fraction dt of variables from cell ny, True is: S + 
dt(dme, 6m3, dn) + dt (d'ma, 6’ms3, 6'n). If we set a variable from cell ng) 
False, the expected changes can be obtained by just swapping the role of k 


and J in the above description. 
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